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' In the cerebral cortex, neurons are subject to a continuous bombardment of synaptic inputs 

' originating from the network's background activity. This leads to ongoing, mostly subthreshold 

, membrane dynamics that depends on the statistics of the background activity and of the synapses 

■ made on a neuron. Subthreshold membrane polarization is, in turn, a potent modulator of neural 

responses. The present paper analyzes the subthreshold dynamics of the neural membrane po- 
tential driven by synaptic inputs of stationary statistics. Synaptic inputs are considered in linear 
interaction. The analysis identifies regimes of input statistics which give rise to stationary, fiuctu- 
ating, oscillatory, and unstable dynamics. In particular, I show that (i) mere noise inputs can drive 
' the membrane potential into sustained, quasiperiodic oscillations (noise-driven oscillations), in the 

(N . absence of a stimulus-derived, intraneural, or network pacemaker; (ii) adding hyperpolarizing to 

depolarizing synaptic input can increase neural activity (hyperpolarization-induced activity) , in the 
absence of hyperpolarization-activated currents. 
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>-,. I. INTRODUCTION 

^ : 

L^?' Cortical pyramidal cells fire action potentials at an average spontaneous rate of about 10 spikes/s in waking animals 
p7| , p8| . At such a low spike rate, it is clear that most cortical neurons spend a significant amount of time with their 
membrane potential well below the threshold for spike activation. On the other hand, a cortical pyramidal cell receives 
roughly 10000 synapses mostly from other cortical neurons. Since individual postsynaptic events cause transient 
increases in membrane conductance, it follows that the dynamics of membrane potentials is largely controlled by 
' subthreshold stimulation from the continuous network activity. Subthreshold membrane polarization is, in turn, a 
^\ : potent modulator of stimulus-driven spike activity |3| p3 . 
' In this paper, I analyze the subthreshold dynamics of t ; 

of general stationary statistics. Such conditions are given in neurons that do not respond to an external stimulus, 
■ but are exposed to the network's spontaneous or stimulus-driven background activity. The generation of postsynaptic 
c/3 \ potentials (PSPs) and their propagation along the dendrites of a neuron are modeled in a rather simple way to 
^ ■ allow for a thorough analytical treatment. Accordingly, the focus is on generic patterns of behavior rather than on 
c/3 ' quantitative results. Some of the conclusions are discussed in relation to the experimental literature. 

F^' II. MODELING SYNAPTIC RESPONSES 

> : 
• ^ . 

, The potential V across a local patch of passive membrane is described by 

where Tm and gm are the passive membrane time constant and leak conductance, respectively, and / is the current 
passed along the dendrites from other parts of the cell. The membrane's resting potential is set to zero. After a 
synaptic input has been received on the considered patch of membrane, the potential obeys 

^V^~—V+^I+^^{V,-V), (2) 
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where Vs and Qs are the synaptic reversal potential and conductance, respectively. Let Vo{t) and Vin{t) be solutions to 
Eqs. (|l]) and (||), respectively, with Vo(0) = X^n(O) = ^(0)- Synaptic ion channels are open for a brief period 6s <C 

At time t — Ss, when synaptic channels close, the deflection of the membrane potential due to the synaptic input 

is 



ViniSs)-VoiSs) 



9s 



[Vs - 1/(0)] + o 



(3) 



This deflection propagates along the cell's dendrites. Far away from its point of origin, I model the synaptic response 
as a PSP. In a passive cable, the rise time and amplitude of a PSP depend on the time course of the synaptic current, 
and the relative locations of the synapse and the point on the membrane at which the PSP is observed; the decay-time 
constant approaches for long times |2j, ^ |3^ . However, computer-simulation studies involving realistic cell 
morphologies |9j and voltage-dependent dendritic conductances |^ have revealed that PSPs in real neurons may 
be less variable than suggested by a cylindrical passive-cable model. A coarse but, for the present analysis, sufficient 
approximation to a PSP is given by the impulse response of a second-order low-pass filter. 



K{l,Vs,h;t) := 7 [T4 - F(to)] ^^exp(^l-^^ Q{t - t,) , 



with the unit-step function 



Q{t) := 



for t < 0, 

1 for t > 0. 



The PSP's amplitude is 7 [V^ - ¥{1^)], with the factor 



7 := a > 



(4) 



(5) 



(6) 



Thus, the PSP is initiated at time has a rise time and decay-time constant r, is attenuated or amplified by a factor 
a [cf. Eq. (^)], and is assumed to propagate instantaneously. It qualitatively captures the basic properties of real PSPs 
of having a finite rise time and an exponential decay phase. It is chosen here for its convenience for analysis. 

Postsynaptic conductance changes are very local compared to the extended dendritic trees on which synapses make 
contacts. It is therefore a reasonable approximation to treat them as noninteracting. The total membrane potential 
under synaptic control is hence given by the sum 



y(t) =^A(7„s„t,;i) 



(7) 



i=l 



for the whole cell. Here ti < ^2 < ... arc the times of synaptic input received by a neuron; 7^ and Si are the 
ampl itude-related factor defined in Eq. (||) and the reversal potential of the ith synaptic input, respectively. In Sec. 
HIE, I will address effects of delays in the propagation of PSPs. 



III. ANALYSIS AND RESULTS 

Upon inspection of Eqs. (|^) and (|7|), it is clear that there is an equivalence relation between the statistics of the 7i 
and of the pairs (s^, t^). Higher values of 7^ have the same effect on the dynamics of V{t) as shorter intervals ti+i — ti 
between successive stimuli with Si = Si+i. In order to simplify the analysis, without limiting the dynamic repertoire 
of V{t), it is preferable to restrict to one value 7 = 7^. In this section, I shall thus derive analytical results on the 
dynamics 

V{t) - 7 E - ^(^^)] <5^P [} - ^ j - ^0 • (8) 

Moreover, the results will be illustrated by computer simulations where appropriate. 

Arguably, the "obvious" approach to the problem is to specify the distribution functions for the point process that 
models the times ti of stimulus events and write down integral equations for the moments of V{t). However, we 
shall take a different approach. We will start by casting the dynamics in the form of a Markov chain. There are 
two significant advantages proceeding this way. First, it will allow us to go quite far with the analysis without being 
specific about the stimulus process. Only at some later point will it be profitable to specify the statistics of stimulus 
times. Second, making use of the Markov property, we will gain insight not only into the dynamics of moments of the 
membrane potential, but also into the temporal pattern of individual trajectories V{t). 
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A. Markov formulation of the dynamics of the membrane potential 

Introducing the notation 



=1 

rj tj+i - tj , (11) 

we can reformulate the dynamics of Eq. (|^) for the discrete times t — tj as an iteration of a combination of two 
stochastic maps TZ{r) and S{s), 



7^(r,_l)o5(s,_l) ^ ^ ) , xi=yi=0, (12) 



(" - , ^ ^)> (13) 



yj Vy + 7 (s - 2;) 



The interstimulus times rj and the synaptic reversal potentials Sj are stochastic variables, drawn independently from 
densities u{r) on and v{s) on R, respectively. These densities are determined by the neural network activity 
and the number and types of synapses on the neuron considered. Note that although there may well be statistical 
dependences between rj and Sj, and (r^, sj) and (r-,/, Sj') {j ^ j') as sampled at one individual synapse, these do not 
show up in the sequences rj and sj for all synaptic inputs to a cortical neuron. 

In the present formulation of the dynamics, the synaptic input times tj are, like Xj and yj, stimulus-driven stochastic 
variables and may be incorporated by extending the system ( p^ ) with the equation 

tj = tj^i + rj_i . (15) 

This equation can be solved independently of Eq. (p^). In particular, 

{t,) = {j-l){r)+t, . (16) 

Here and in the following, we encounter mean values of the types 

ds'v{s')f{s') , (/(r)) / dr' u{r') f{r') , (17) 
-00 Jo 

with / being some function on the real numbers for which the integrals are defined. 

The dynamics ( p^ ) is a Markov chain. The transition probability corresponding to S{s) is 



ps{x,y\x' ,y') ^ dsv{s)S{x ~ x')5[y - y' - ■^{s - x')] , (18) 
J —00 

and the one corresponding to Tl{r) is 

pn{x,y\x',y')^ J^^ dru{r)6[x-(x' + ey'^)e-^/^]d{y-y'e-'^^^) . (19) 
Here 5 is the Dirac delta function. Let y) be a joint probability density for x and y. Then 

(x"?/") / dx' dy'p{x',y')x"'y'"' , n,meN, (20) 



OO 
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are the moments of x and y. We want to know how the moments change under the action of TZ{r) o S{s). For the 
action of S{s), we get 



dx 



OO ^— OO J —OQ J —OO 



dy I dx' I dy'ps{x,y\x',y')p{x',y')x^y"' 

= E (,7,)(-i)V^^^'')(-"^v) , (21) 



h + i+j = n 



with polynomial coefficients 
The action of 7?.(r) yields 



h,i,jj ' h\i\j\ 



h + i + j = m 



(22) 



dx I dy I dx' / dy' pTi{x,y\x' ,y')p{x' ,y') x^y"" 

= E (fc) ( (v) ' e-("+'")'-/^^ . (23) 



Let pj{x,y) be the joint probability density of x and y at time fj. By combining Eqs. ( pT| ) and (|2^), we can write 
down iteration equations for the moments, 



dx' / dy'p,(a;',y')^'"y"" 



(24) 



The iterations can be solved successively for all n and m, starting with the first moments. We shall solve for the 
first two moments, i.e., for {x)j, {y)j, {x'^)j, {xy)j, and Note that the ensemble averages (24) are not taken at 

constant time t, but rather at a constant number j of synaptic inputs received, irrespective of the time tj of the jth 
input. As mentioned above, the times of synaptic inputs are additional random variables obeying Eq. (15). 



B. Mean membrane potential 



The iteration dynamics of the mean values obtained from Eqs. ( |2l| ) and (23) is 



= :Mi 

with the stimulus parameters (s) and 



ai := (e--/^) 
bi := {^e^-^'-) 



e(0,l). (26) 



The dynamics of {x)^ and {y)- depend on the eigenvalues of Mi, and thus on the stimulus parameters ai and bi. The 
eigenvalues are 

Ai/2 :=ai-^± 1^^7^52-470161 . (27) 
For convergence of the dynamics, we require that 

|Ai/2|<l ^ 7&i<(ai + l)2. (28) 

Figure |^ shows the parameter regions of convergence and divergence. In this parameter space, the vicinity of the 
point fli = 1, 61 = is occupied by high-frequency stimuli, i.e., with short interstimulus times r. A very low network 
activity, on the other hand, lies close to the point oi = 0, 61 = 0. It turns out that for any input statistics, the mean 
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FIG. 1: Space of stimulus parameters ai and bi that determine the dynamics of the mean membrane potential. The dynamics 
converges for (ai + 1)^ > 761. For 761 < 4ai, the two eigenvalues given by Eq. ( p7| ) are complex conjugate. For (ai + 1)^ > 
761 > 4ai, they are real and negative. The corresponding type of mean dynamics is depicted for these two regimes. 




ai ai 



FIG. 2: Left: Contour plot of the asymptotic mean membrane potential {x)oo- Dashed lines delimit the regions of different 
mean dynamics shown in Fig. |l| Assuming Poisson statistics for stimulus times, the stimulus parameters ai and 61 lie on 
parabolas, here plotted for 7 = 0.2, 0.7, . . . , 3.7. Right: Plot of {x)oo/{s) for Poissonian stimulus times and the same values of 
7 as on the left. The curves are interrupted where (ai + 1)^ < 761 such that the mean dynamics is divergent; cf. Fig. |l[ 



of the membrane potential V converges, if the factor 7, controlling PSP amplitudes, is sufficiently small. For 761 > 4, 
on the other hand, the mean dynamics will never converge. 
From Eq. (^ ) we obtain the asymptotic values 

hm {V{t)) = (x)^ = ^—7^ T2 ('^) ' (29) 

2/ 00 = , , /-I s> (30) 

°° 76i + (l-ai)^ 

for the regime of convergence. A contour plot of (a:) 00 as a function of oi and 761 is shown in the left graph of Fig. 
||. For the times tj of synaptic input being consistent with a Poisson process, it is shown in the Appendix that the 
stimulus parameters oi, bi lie on a parabola, plotted in the left graph of Fig. |2| for different 7. The ratio (a:)oo/('S) 
behaves then as shown in the right graph of the figure. Not surprisingly, the mean membrane potential is pulled closer 
to the mean synaptic reversal potential (s) with increasing oi, that is, with increasing stimulus frequency, and with 
increasing PSP amplitude 7. 



For 761 < 4ai, the eigenvalues A1/2 are complex conjugate. In Sec. Ill C, I will show that only then will the variance 
of V{t) converge. As depicted in Fig. [|, in this regime {V{t)) converges in a damped oscillation. The dynamics is 
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solved straightforwardly. Let L be the matrix that diagonalizes Mi, i.e., LMiL ^ is diagonal. Furthermore, let 



K 



1 1 

i — i 



Then the matrix KL is real and we can write the powers of AIi as 



cos{j(f>) ~ain{j(f)) 
sin(j0) cos(j0) 



KL , with (f) :— arg(Ai) . 



The iteration dynamics (pq) is solved by 



\{y)J \{y)c 



M'i 



(y>c 



(31) 



(32) 



(33) 



that is, a spiral motion around the attractive focus {{x}^ , (j/)^^). Its angular period is, measured in the number of 
synaptic input events. 



P 



27r 



arg(Ai) 



and averages in real time to 



(r)=P(r) 



(34) 



(35) 



Thus (T) is the mean period of {V{t)). Moreover, it may be shown easily that P is the period of the covariance 
function, 

cov(xj,Xj+k) := {(xj - (x)^^ (^Xj+k - {x)j+k)) 

dy dx' dy' pkix,y\x',y')pj{x',y') (x- {x)j^A (x' - {x)-j , (36) 



dx 



— oo — oo >.' — OO — oo 



where 



pi{x,y\x',y') 



dx 



dypn{x,y\x,y)ps{x,y\x' ,y' 



(37) 



Pk{x,y\x ,y) := dx dy pi{x,y\x,y) pk-iix,y\x ,y ) for /c > 1. 



In particular, the asymptotic covariance function limj^oo cov{xj,Xj+k) alternates between phases of correlation and 
anticorrelation with period P. In Sec. HID, I will show that under certain stimulus conditions these oscillations of 
the membrane potential never die out for individual realizations of the stochastic process. The damping of the mean 
oscillation is then due to a loss of phase coherence with time. 

For Poissonian stimulus times tj , the mean oscillation period is given by 



27r y/ arctan 
^""(r) / 1^^ + arctan 



-ye7(r/r)[(4-e7)(r/T)~ 
(2-e7)(r/r)+2 



^e7(r/r)[(4-e7)(r/T)+4] 
(2-e7)(r/r)+2 



for (2-e7)(^)+2>0, 
elsewhere; 



(38) 



cf. the Appendix. Figure || shows plots of (T/r) for different 7, both as a function of (r/r) and ai. For (r/r) > 
4/(e7 — 4) or, equivalently, ai < 1 — 4/ (67), the stimulus enters the regime where A1/2 are real and negative, and the 
mean period ends up on the curve 



(39) 



plotted with the dashed lines in Fig. For (r/r) or, equivalently, ai 1, we find that (T/t) approaches zero. 
In particular, (T) can be much shorter than the rise time r of PSPs. 
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ai (r/T) 



FIG. 3: Mean oscillation period (T) of the membrane potential in units of the rise time r of PSPs [cf. Eq. plotted as 
a function of the stimulus parameters ai (left) and {r /t) (right). For the curves we assume Poisson statistics for stimulus 
times and 7 = 0.2, 0.7, . . . , 3.7. The mean oscillation period lies on the dashed curves for ai < 1 — 4/(e7) or, equivalently, 
(r/r) > 4/(e7 ~ 4). 



C. Variance of the membrane potential 



To estimate whether the trajectories V{t) stay bounded when their mean converges to a finite value, we have to 
check whether their varian ce converges as well. We will now analyze the dynamic map for the second moments of x 
and y defined in Sec. Ill A . From Eqs. ( |2l| ) and (p3|), we obtain 



02 - 7^2 + 7^C2 

-7^2 + ^62 
2 

7 a2 




(40) 



with the stimulus parameters 



0-2 
C2 



^2rgl-2,./r^ 
' r\2 g2-2r/i 



e (0,1) , 



and 



(762 - 27^02) {s) {x)^ + 27C2 {s) {y)^ + 7^02 {s") , 
(7a2 " 7'&2) (s) (a;) J- + 7^2 (s) (y), + i7'fe2 (s') , 
-27^02 (s) (a:), + 2702 {s) (y), + 7'a2 (s') ■ 



(41) 



(42) 
(43) 
(44) 



The {x)j and {y)j converge to the values given in Eqs. (H) and (|^) such that {uj jVjjWj) will become constant. To 
check convergence of the second moments, it is thus necessary and sufficient to consider the eigenvalues of Af2. These 
are the roots of the characteristic polynomial 



- (3a2 - 2762 + 7^C2) + (^iaj ~ 7- 



1 



a2C2 - 270262 + 62 



, 



(45) 



and are rather lengthy expressions which need not be spelled out here. Depending on the stimulus parameters 02, 62, 
and C2, there are one real and two complex conjugate eigenvalues, or three real eigenvalues. Let v\ be the eigenvalue 
that is always real and z^2/3 the other two that may be complex conjugate or real. Stimulus parameters 02, 62, C2 that 
yield a convergent second moment of V(t) are those that obey the constraints 



\v\\ =: /i(a2,7&2,7^C2) < 1 , max(|iy2| , ji^al) /2(a2, 7^2, 7^C2) < 1 , 



(46) 
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with continuous functions /i and /2. The two surfaces defined by 

/i (02,7^2,7^^2) = 1 , 72(02, 7^2, 7^C2) = 1 



(47) 



are shown in Fig. ^. Since convergence is obviously ensured for 7 0, which yields Xj = yj = [cf. Eq. (|T^)], the 
parameter region that results in convergence of the second moments is the space between the two surfaces that includes 
the axis (02,762,7^02) = (o2,0,0), 02 S (0, 1). In the region beyond the intersection of the surfaces, i.e., for roughly 
7^C2 > 9, there are no combinations of parameters that yield convergent second moments. 

For Poisson statistics of the stimulus times tj , the stimulus parameters 02 , 62 , C2 lie on the curves plotted in Fig. 
^ for different values of 7; cf. the Appendix. The curves run from (02,762,7^02) = (0,0,0), the limiting point for 
low input activity ((r) = 00), to (02,762,7^02) = (1,0,0), the limit of high-frequency stimulation ((r) = 0). For 7 
sufhciently small, the curves lie completely within the region of convergence. For larger 7, they are in the region of 
divergence except near the point (02,762,7^02) = (0,0,0). For (r/r) ^ 1, which is the realistic regime for cortical 
neurons, the eigenvalues 1^2/3 are complex conjugate and we get 



1^1 = 



r2/3| = 



1 - 
1 - 



2- 



67 



O 



3/2 



.j.y3/2 



(48) 
(49) 



It follows that for (r/r) <C 1, it is necessary and sufficient for the second moments to converge that 7 < 4/e. In fact, 
Fig. ^ shows that at least for 7 < 1.2 the second moments converge for all < (r/r) < 00, corresponding to the entire 
curves running between (02,762,7^02) = (0,0,0) and (02,762,7^02) = (1,0,0) in the parameter space. 

As shown in the Appendix, the condition 7 < 4/e is for Poisson statistics of the times tj equivalent to 4ai > 761 
for all ai G (0, 1). In the following, we will assume this condition to hold. The system is thus always in the regime of 
damped oscillations of {V{t)); cf. Fig. |^. 

After some lengthy but straightforward algebra, we find for the asymptotic variance of x, and hence of V{t), 



lim var[y(t)] = varoo(a;) := (a;^)^ - (x)^ = (s^) pi - {sf p2 , 



(50) 



with coefhcients 



Pi 



P2 



72 (62^ + 2o2 - 20202) 



2(1 



02)^ + 47 (1 — 02) 62 + 7^62^ 
7'6i2 



272(1 + 02)02 



(1-01)^761 
27' [oi (1 



(51) 
(52) 



oi) (62^ + 2o2 - 20202) + 61 (62 - 0262 - 27C2)] 



(1 - aif + 761J [2(1 - 02)^ + 47 (1 - 02) 62 + 7^^2^ - 272 (1 + 02) 02 
For Poisson statistics of the stimulus times tj, the coefficients pi/2 simplify to 



Pi 

P2 



4e7 - (07)2 + 4 (r/r) ^ ^ ' 
(67)3 (67 + 2 (r/r)) 
[467 " {eiY + 4 (r/r)] (07 + (r/r))^ 



> 



(53) 
(54) 



cf. the Appendix. 



D. Stationary states, fluctuations, and noise-driven oscillations 

We have seen in the two previous sections that there is a region of stimulus parameters where the mean and variance 
of V{t) converge to finite values. Averages do not tell us, however, what individual trajectories V{t) look like. In this 
section we want to gain insight into the temporal pattern of individual trajectories. 
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T - 3,7 



FIG. 4: Three different views of the two surfaces 
defined in Eq. (^) in the space of stimulus param- 
eters a2, 62, and C2. The region of parameters that 
result in convergence of the second moment of the 
membrane potential is the space between the two 
surfaces that includes the 02 axis. Parameters for 
Poissonian stimulus times lie on the thick curves 
for 7 = 0.2, 0.7, . . . , 3.7. The graphs show that 
convergence is ensured for all Poissonian stimuli, 
if 7 < 1.2. 
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FIG. 5: Typical trajectories of the membrane potential V{t), simulated for various stimulus conditions as indicated by the row 
and column labels of the array of graphs. The unit of time is the rise time r of PSPs [cf. Eq. Synaptic reversal potentials 
are uniformly distributed in the intervals [(s) — As, (s) + As]. The membrane potentials V = (resting potential) and V = (s) 
are indicated in each graph by the solid and dashed lines, respectively. The graphs show the transitions between stationary, 
fluctuating, and oscillatory dynamics of V{t) as discussed in the main text. The PSP-amplitude factor 7 — 0.1 for all graphs. 



Let us first deal with ttie short-time behavior of individual trajectories {xj,yj). We ask what they look hke for the 
first few J, that is, the first few synaptic inputs. The variances 

vavjix) := (x'^)^- {xfj , ^W[j{y):^{y^).-{y)] (55) 

are zero initially. They increase to finite values no faster than the fastest-growing linear combination of second 
moments, i.e., like e"^^*^ with 



Q = -l ^ln(^^minj:.,| j . (56) 

We have to compare Q to tlie period P of tlie oscillation of the mean values {{x)jJjj)j) in order to see whether this 
oscillation shows up in individual realizations {xj,yj). From Eqs. (^^, (^), and ( ^9| ) we obtain 



T / \ \ T 



Thus for (r/r) sufficiently small, we get P/Q <^ 1 and the oscillation of the means {x)j, {y)j is fast as compared 
to the growth time of the fiuctuations var_,(a;), vavjly) around the means. Individual realizations {xj,yj) are then 
well described by their means for several periods of the oscillation. Put differently, an oscillation with a mean period 
given by Eq. (|3^) then shows up in individual realizations V{t). With longer interstimulus times {r/r), fluctuations 
increasingly interfere with the oscillation. The transition from an oscillation-dominated to a fluctuation-dominated 
dynamics of V{t) is depicted in Fig. ^. 

It remains to establish the long-time behavior of trajectories (xj^yj). The dynamics ( ^3| ) of their mean value 
spirals into the point {{x) 00 , {y) 00) ■ Without damping of the oscillation, the trajectories would he on orbits deflned 
by q{x — {x)oc,y — (j/)oo) — const, with the quadratic form 

qi^, V) ((C, {KL)^KL{^, r;)) = -L^ - 4701^77 + 4ai77' . (58) 

Ol 
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To estimate the true degree of damping of individual trajectories {xj,yj), we calculate the mean asymptotic ratio 
{q/Qo)oo with the initial value Qq :— q{{x)oo, {y)oo) of the quadratic form q. From Eq. ( ^0|) we obtain the three 
second moments {x^)oo, {xy)oo, and {y'^)oo which are needed for the calculation of {q)oo- After some lengthy but 
straightforward algebra, we find 



,qo 

where the coefficients are for Poisson statistics of synaptic input times tj , 



^ = TTl'P^ - P2 ' (59) 



4e7 - (e7)2 + 4 (r/r) 
cf. the Appendix. For var(s) = (s^) — (s)^ = 0, it follows that 



2(e7+(r/r))^ 

= 4e7 - (67)^ + 4 (r/r) ^ ° ' ^^^^ 
2e7(e7 + 2(r/T)) 

^2 = 1 7 — xn , , , , X > ; (61) 



q \ 2(r/Tf 1 / r\ 

qo/oo 4e7 - (67)2 + 4 (r/r) 2 \r/ 

Hence there is strong damping, and individual trajectories (xj,yj) converge close to the steady mean state, if synaptic 
currents have all the same reversal potential. On the other hand, for var(s)/(s)2 ^ 1, hence {s^) / {s)'^ ^ 1, we 
get (9/90)00 3> 1 and there is no damping of individual trajectories {xj,yj). Since the dynamics is a temporally 
homogeneous Markov chain, at any time we then find qualitatively the same situation as at the start of the process. 
Thus there is no qualitative change in the trajectories (xj , yj ) on a long time scale, and the pattern of evolution, random 
fluctuations or oscillations, that dominates initially (see above) will also prevail at all times. Figure ^ summarizes the 
types of dynamics of V(t), illustrating our results on short- and long-time behavior by computer simulations. 

With synaptic reversal potentials Sj having a high variance, we have seen individual trajectories V{t) to oscillate or 
fluctuate persistently around the value limt^ooiVit)) = {x)oo- It is interesting to compare the mean of the intervals 
A = t — t' between successive times t > t' defined by 

V{t) = V{t') = {x)^ , ^V{t) > , ^V{t') > , (63) 

the mean "jitter period", with the mean oscillation period (T) [cf. Eq. (|3^)] of {V(t)). I have measured jitter periods 
in computer simulations of V{t). As can be seen in Fig. |^, the match between the two periods is perfect for small 
(r/r), that is, in the regime where oscillations are rather regular. For increasing interstimulus times {r/r), when the 
random- walk component of membrane dynamics grows stronger (cf. Fig. the mean jitter period drops below the 
mean oscillation period, indicating that fluctuations cause V(t) to jitter around its asymptotic mean value faster than 
the oscillatory component of the dynamics alone. 

E. Delays 

The conduction of synaptic currents in neuronal dendrites leads to delays relative to the time of the synaptic input. 
Let us assume here that we can assign a delay di > to a PSP initiated at time ti, such that at time ti + di the 
response is spread out across the whole neuron. Of course, such a delay does not properly describe gradual PSP 
propagation. In a sense, it is the opposite extreme of the instantaneous PSP propagation that wc have considered so 
far. The dynamics of the membrane potential with such delayed PSPs is given by 

00 

T/(i) = ^A(7„s„t,;t-d,) ; (64) 



cf. Eq. (|^). A reformulation as a Markov chain as in Sec. [II A is now not possible. This fact calls for a reconsideration 



of our previous results. Here I am concerned with proving structural stability of the dynamics analyzed above with 
respect to small delay perturbations. To this end, we may extend the previous dynamics to incorporate first-order 
delay effects. The issue of delays is covered in detail in |l^ for a slightly more general class of dynamical system. In 
this paper, I only sketch the way to proceed. 



12 



(T/r) 
(A/r> 




0.02 



. 04 



0.06 



.08 



0.1 

(r/r) 



FIG. 6: Comparison of the mean oscillation period (T) of the membrane potential as given by Eq. (solid line; cf. Fig. ^) 
with the mean jitter period (A) defined in Eq. ( |63| ) as observed in computer simulations (box symbols; bars indicate standard 
errors). The unit of time is the rise time r of PSPs [cf. Eq. (^)]. The match between the two periods is perfect for small 
(r/r), when oscillations are rather regular. As oscillations are increasingly degraded by fluctuations for larger (r/r) (cf. Fig. |5), 
the mean jitter period drops below the mean oscillation period. In the simulations, synaptic reversal potentials are uniform y 
distributed in an interval with (s) = 0; the PSP-amplitude factor 7 — 0.1. 



Expanding Eq. (^) to first order in the delays di/r, we have to note that A(7i, Si^tf, t) is not differentiable at i = 
cf. Eq. (|). We can take advantage of the fact, however, that di > Q and write 



A{'ji,Si,ti;t- di) 

A/ 4 +\ , J r A(7i,s,,t,;i) - A(7i,s,,i,;i-o?) ^ 



(65) 



A{ji,Si,ti;t) + — ( 1 - - I e 

T \ T 



1-t/r o 



e(^ - ti) + o 



that is, we take the derivative of A(7i, Si, t^; i) from lower values of t. Equation ( |65[ ) is substituted into the dynamic 
Eq. ( |64[) and only terms up to first order in di/r are kept. As before, we use 7 = 7^ to obtain a model with a minimal 
set of variables. We can now transform to new dynamic variables xj := V(tj), yj, and Zj that obey the stochastic 
iteration 



Vj ==7^'(rJ_l)o5'(sJ_l,o^J_l) y-j-i , xi = yi = zi ^ Q , 



(66) 
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y + ^{s-x) (1 + f) 
z + -i{s~x)^ 

,-r/T 




(67) 
(68) 



The dimension of the stochastic dynamic map is increased by one compared to the case without delays; cf. Eq. (|l^). 
Treating Eq. (|6^) analogous to Eq. (p^), we can derive dynamic maps for the moments of z, y, and z. These will have 
accordingly higher dimensions than those for the moments of x and y without delays. This underlines the necessity 
to check the structural stability of the dynamics derived previously. 

It can be shown ||l5|| that the dynamics for the first and second moments of x and y is stable with respect to small 
delay perturbations, provided that 



762 < 2(a2 + 1)= 



(69) 



In general, this is a condition for convergence in the delayed system that is additional to those derived for the 
undelayed system. For Poisson statistics of synaptic input times, however, we know that 02 and 62 he on the parabola 
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^2 = ea2(l — 0,2)', see the Appendix. Together with the condition 7 < 4/e derived in Sec. IIIC for the convergence of 
the variance of V{t), this imphes condition (|69|). 

By continuity of eigenvalues and asymptotic values in the delays within the extended model, it follows that for 
small delays there is only a small quantitative and no qualitative change in membrane dynamics. All that has been 
concluded on patterns of the dynamics hence remains true for small delays. Moreover, it can be shown that small 
delays decrease the asymptotic attraction of {V{t)) to the mean synaptic reversal potential (s) and increase the mean 
period (T/t) of membrane oscillations |15{. 



IV. SUMMARY AND DISCUSSION 



In this paper, I have analyzed the subthreshold dynamics of the neural membrane potential driven by stochastic 
synaptic input of stationary statistics. Conditions on the input statistics for stability of the dynamics have been 
derived. Regimes of input statistics for stationary, fluctuating, and oscillatory dynamics have been identified. For the 
case of Poissonian stimulus times, that is, temporal noise, it has turned out that persistent oscillations can develop 
with a mean period that depends nontrivially on the mean interstimulus time. In particular, noise-driven oscillations 
occur in the absence of any pace-making mechanism in the stimulus, in the intrinsic neural dynamics, or in a recurrent 
neural network. 

What does it mean for a real neuron, if its membrane potential is "unstable" under stimulation by the network's 
synaptic input? As the analysis has shown, instability of the first or second moments implies excursions of V{t) with 
growing positive and negative amplitudes. After some stochastic period of time, therefore, the membrane potential 
will certainly cross the threshold for firing. The neuron will then be set to a post-spike potential that depends in 
some way on the stimulus history and the process will resume. 

I have neglected many effects in the modeling for the sake of analytical feasibility. Most notably, PSPs have been 
given a shape that does not properly reflect conduction in neuronal dendrites. One shortcoming is a lack of variability 
of PSP shape; see, however, |^, |l^. Another is that real neuronal membranes contain ionic conductances which are 
voltage-gated [Q. Their effect is to modify the shape of PSPs in a voltage-dependent manner as they are propagated 
along a dendrite; see, e.g., ||l|. Moreover, with voltage-gated channels, PSPs do not simply add up but interact 
nonlinearly. The conclusions drawn in the present paper, therefore, can only be on qualitative system behavior and 
should not be understood quantitatively. 

In the analyzed model, there is no representation of the spatial dimensions of a neuron. For a neuron where spatial 
conduction times are significant, the present results suggest that spatiotemporal waves of membrane potential develop 
in the regime of noise-driven oscillations. For the generation of action potentials, however, all that matters is the 
potential at the cell's soma. 



A. Oscillations in stochastic systems 



It is a common example in textbooks on stochastic dynamical systems to calculate stationary densities for a 



damped harmonic oscillator subject to an external stochastic force; see, e.g., |17 . If the damped oscillator is in the 



periodic regime, the intrinsic oscillations are sustained by the stochastic force. In the context of biological systems, 
stochastically sustained oscillations have been analyzed, somewhat heuristically, for the population dynamics of an 
epidemic model This system is autonomous and an intrinsic oscillator. The stochastic nature of the dynamics 
prevents asymptotic convergence to a steady state. 

It is thus a known generic property of periodic relaxation systems to exhibit oscillations at their intrinsic frequency, 
sustained by some stochastic influence. The dynamics analyzed in this paper, however, represents a different type 
of phenomenon. The system studied is not an intrinsic oscillator but exhibits oscillations at a mean period that is, 
up to a temporal scale, determined by the stochastic drive alone. The system can be formally viewed as a control 
loop where a sequence of brief signals (the synaptic reversal potentials Sj) controls via a slow response (the PSPs) a 
dynamic variable [the membrane potential V{t)]. The theme of the control loop is fully developed in ||l5|, |l6| . 



B. Oscillations in neural systems 



Oscillations of membrane potential and spiking activity are quite ordinary in the neural systems of the brain. They 
arise under various conditions, with varying degree of correlation between neurons, and in a wide range of frequencies. 
Their functional implications may be equally various and are much debated today. 



14 




FIG. 7: Demonstration of hyperpolarization-induced activity. The three graphs show long-time simulations of the membrane 
potential V{t). Transients at the start of the simulation are cut off. The unit of time is the rise time r of PSPs [cf. Eq. (|)]. 
Depolarizing synaptic input is applied with mean interstimulus time (r/r) = 0.1 and reversal potential Sdep > as indicated 
by the upper dashed line in each graph. There is no hyperpolarizing synaptic input for the left graph; for the central graph 
there is hyperpolarization with (r/r) = 0.5; for the right graph with (r/r) = 0.1. The hyperpolarizing reversal potential is 
Shyp ~ —Sdep < as indicated by the lower dashed line in each graph. If the threshold for spike generation is assumed close 
to Sdep, there will be no spikes for the case without hyperpolarizing input (left), a few spikes for weak hyperpolarizing input 
(center), and again no spikes for equal hyperpolarizing and depolarizing input (right). The PSP-amplitude factor 7 = 0.1 for 
all graphs. 



Explanations of oscillations have been basically of two kinds. One is in terms of intrinsic oscillator cells that act 
as a pacemaker for rhythmic activity in the network |2^. The other makes reference to the fact that recurrent 
neural networks have a natural tendency to produce rhythmic and synchronized activity ^] . 

Some of neural oscillations are most probably generated by the intrinsic neural dynamics of ion channels. Others 
are propagated by synaptic potentials and are of less certain origin. A prominent example of the latter kind are 
cortical oscillations in the gamma frequency band (roughly 20-90 Hz). Cortical gamma oscillations are mostly evoked 
by a sensory stimulus. Thus, spontaneous activity in the visual cortex of awake cats and primates is rarely oscillatory, 
whereas visual stimuli of increasing speed of motion produce subthreshold and suprathreshold oscillations of increasing 
frequency 1, 1,0, |ll, 1^,1^. 

The results presented here suggest that oscillations of the neural membrane potential can arise from the network's 
background activity. Let us assume that a stimulus evokes responses in neurons of a coupled system at a rate that 
increases with stimulus speed, because more neurons in the network are stimulated per time at higher speeds [ p2[ . 
The observed dependence of oscillations on a stimulus is then predicted by Sec. Ill D , the relation between oscillation 
period and stimulus speed by Eq. (p8|). Note that the conditions {r/r) <^ 1 and var(s)/ (s)^ ^ 1 for the development 
of noise-driven oscillations are probably fulfilled under external stimulation of a network of cortical neurons, each 
receiving roughly 10000 synapses of both an excitatory and inhibitory kind The degree of correlation between 
neurons that is to be expected from noise-driven oscillations increases with the extent to which they share common 
input from the network's background activity. Correlations should, therefore, decrease with distance between neurons, 
in agreement with what is generally observed. In a network of spike-exchanging neurons, however, correlations can 
even arise between neurons that do not share any input. 

The present analysis draws attention to a phenomenon, noise-driven oscillations, that should be very common in 
neural systems and may be the cause of some of the observed membrane-potential oscillations. 



C. Hyperpolarization-induced activity 

There is an interesting consequence of the analytical results. It is, at first sight, somewhat counterintuitive. Consider 
a neuron that receives depolarizing synaptic input at a fixed average rate. Let us assume that at this level of 
depolarization the membrane potential remains mostly below the threshold for spike generation. Now, if we add 
some hyperpolarizing synaptic input, it turns out that the neuron may actually start spiking. Further increase of the 
hyperpolarizing input rate eventually shuts neural activity off. This scenario is demonstrated in computer simulations 
shown in Fig. |7|. 

The effect seems to be at odds with the usual notion of hyperpolarizing synapses to inhibit neural activity rather than 
promote it. Exceptions have only been reported for cases where a hyperpolarization-activated current repolarizes the 
cell, giving rise to a rebound burst of action potentials; see, e.g., [|l^, The effect demonstrated here is of a different 
nature. It results from an increase of membrane fluctuations with the addition of hyperpolarizing synaptic input; cf. 
Eq. (|50|). For a range of hyperpolarizing input rates, increased fluctuations are likely to spontaneously overcome the 
associated drop in mean membrane potential; cf. Eq. (|^. The result is fluctuation-driven spike generation. 
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The phenomenon of hyperpolarization- induced activity offers a subtle way in which neural spiking may be controlled. 
Whether it is actually used in the brain is unexplored today. 



APPENDIX A 



It is reasonable to assume the times tj at which synaptic inputs are received by a cortical neuron from other cortical 
neurons to obey Poisson statistics. For the density u of interstimulus times r this means 



u{r) 



-r/{r) 



(Al) 



In order to transform the stimulus parameters a^, bi, Ci introduced in Eqs. (^6|) and (|41|), and to reveal dependences 
between them, we calculate the mean values 



d_ 

da 



-ar j r 



d_ 

da 



dru{r)e-°"'l^ 



Hence the stimulus parameters turn out to be 



ai = 



1 + (r/r) 



e {r/r) 
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2 ' 



d 



da J 1 + a {t/t) 



(A2) 



(A3) 



1 



02 = 



_ 2e(r/T) 

"2 — — — , C2 



2e2 {r/rf 



l + 2(r/T) ' (l + 2(r/T))2' {l + 2{r/T)f 

Dependences between these parameters are now explicit. In particular, we have 

6i = (1 - fli) , z = 1,2 . 



(A4) 



In Sec. Ill C| , we have established that for Poisson statistics and small (r/r) the necessary and sufficient condition 
for the second moment of V{t) to converge is 7 < 4/e. Multiplying Eq. (A4) by 7, we see that this bound implies 



jbi < 4ai (1 - ai) < 4ai for e (0, 1), i = 1, 2. 



(A5) 



Conversely, jbi < Aai for all ai e (0, 1) together with Eq. (A4) implies 7 < 4/e 



[1] M Andreasen and J D Lambert. Somatic amplification of distally generated subthreshold EPSPs in rat hippocampal 

pyramidal neurones. J. Physiol. (London), 519:85-100, 1999. 
[2] J P Aparicio and H G Solari. Sustained oscillations in stochastic systems. Math. Biosci., 169:15-25, 2001. 
[3] R Azouz and C M Gray. Cellular mechanisms contributing to response variability of cortical neurons in vivo. J. Neurosci., 

19:2209-2223, 1999. 

[4] V Bringuier, Y Fregnac, A Baranyi, D Debanne, and D E Shulz. Synaptic origin and stimulus dependency of neuronal 
oscillatory activity in the primary visual cortex of the cat. J. Physiol. (London), 500:751-774, 1997. 

[5] N Brunei and V Hakim. Fast global oscillations in networks of integrate- and-fire neurons with low firing rates. Neural 
Comput., 11:1621-1671, 1999. 

[6] M Castelo-Branco, S Neuenschwander, and W Singer. Synchronization of visual responses between the cortex, lateral 

geniculate nucleus, and retina in the anesthetized cat. J. Neurosci., 18:6395-6410, 1998. 
[7] R A Chitwood, A Hubbard, and D B Jaffe. Passive electrotonic properties of rat hippocampal CA3 interneurones. J. 

Physiol. (London), 515:743-756, 1999. 
[8] J Defelipe and I Farinas. The pyramidal neuron of the cerebral cortex: morphological and chemical characteristics of the 

synaptic inputs. Prog. NeurobioL, 39:563-607, 1992. 
[9] A Destexhe and D Pare. Impact of network activity on the integrative properties of neocortical pyramidal neurons in vivo. 

J. NeurophysioL, 81:1531-1547, 1999. 



16 



[10] S Friedman-Hill, P E Maldonado, and C M Gray. Dynamics of striate cortical activity in the alert macaque: I. incidence 
and stimulus-dependence of gamma-band neuronal oscillations. Cereb. Cortex, 10:1105-1116, 2000. 

W Gerstner, J L van Hemmen, and J D Cowan. What matters in neuronal locking? Neural Comput., 8:1653-1676, 1996. 
C M Gray and D A McCormick. Chattering cells: superficial pyramidal neurons contributing to the generation of syn- 
chronous oscillations in the visual cortex. Science, 274:109-113, 1996. 

C M Gray and G Viana Di Prisco. Stimulus-dependent neuronal oscillations and local synchronization in striate cortex of 
the alert cat. J. Neurosci., 17:3239-3253, 1997. 

B Hille. Ionic Channels of Excitable Membranes. Sinauer Associates Inc., Sunderland, MA, 1992. 

U Hil lenbrand. Syatiotemyoral Adaptation in the Corticopeniculate Loop. Docto ral thesis, Technische Universitat Miinchen, 



http:/ /tumbl. biblio.tu-muenchen.de/publ/diss/ph/2001/hillonbrand.pdf. 



2001, 

U Hillenbrand and J L van Hemmen. Spatiotemporal adaptation through corticothalamic loops: A hypothesis. Vis. 
Neurosci., 17:107-118, 2000. 

J Honerkamp. Stochastic Dynamical Systems: Concepts, Numerical Methods, Data Analysis. Wiley, New York, NY, 1994. 
J R Huguenard and D A McCormick. Simulation of the currents involved in rythmic oscillations in thalamic relay neurons. 
J. NeurophysioL, 68:1373-1383, 1992. 

D B Jaffe and N T Carnevale. Passive normalization of synaptic integration influenced by dendritic architecture. J. 
NeurophysioL, 82:3268-3285, 1999. 

B Jagadeesh, C M Gray, and D Ferster. Visually evoked oscillations of membrane potential in cells of cat visual cortex. 
Science, 257:552-554, 1992. 

P E Maldonado, S Friedman-Hill, and C M Gray. Dynamics of striate cortical activity in the alert macaque: H. fast time 
scale synchronization. Cereb. Cortex, 10:1117-1131, 2000. 

D A McCormick and J R Huguenard. A model of the electrophysiological properties of thalamocortical relay neurons. J. 
NeurophysioL, 68:1384-1400, 1992. 

D Pare, E Shink, H Gaudreau, A Destexhe, and E J Lang. Impact of spontaneous synaptic activity on the resting properties 

of cat neocortical pyramidal neurons in vivo. J. NeurophysioL, 79:1450-1460, 1998. 

W RaU. Theory of physiological properties of dendrites. Ann. NY Acad. Sci., 96:1071-1092, 1962. 

W Rail. Cable properties of dendrites and effects of synaptic location. In P Andersen and J K S Jansen, editors, Excitatory 
Synaptic Mechanisms, pages 175-187. Universitetsforlaget, Oslo, Norway, 1970. 

W Rail. Core conductor theory and cable properties of neurons. In Handbook of Physiology. The Nervous System. Cellular 
Biology of Neurons, volume 1, pages 39-97. Am. Physiol. Soc, Bethesda, MD, 1977. 

M Steriade. Cortical long-axoned cells and putative interneurons during the sleep- waking cycle. Behav. Brain Sci., 3:465- 
514, 1978. 

M Steriade, M Deschenes, and G Oakson. Inhibitory processes and interneuronal apparatus in motor cortex during sleep 
and waking. I. Background firing and responsiveness of pyramidal tract neurons and interneurons. J. NeurophysioL, 
37:1065-1092, 1974. 

M Steriade, D A McCormick, and T J Sejnowski. Thalamocortical oscillations in the sleeping and aroused brain. Science, 
262:679-685, 1993. 

H C Tuckwell. Introduction to Theoretical Neurobiology, Volume 1: Linear Cable Theory and Dendritic Structure. Cam- 
bridge University Press, Cambridge, 1988. 

Conduction times of ionotropic synapses are roughly 1 ms, while the membrane time constant is usually several 10 ms Jl^ . 
The other type of synapse, the metabotropic synapse, modulates the membrane potential on a much longer time scale of 
seconds |l^ and is not considered here. 

Different individual neurons respond best at different stimulus speeds, a property called speed tuning. For the complete 
coupled system, however, we may neglect effects of speed tuning. 



